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0 virtual display device and method of use. 

0 A virtual display system is disclosed comprising 
a ligfit source for emitting light (20), at least one area 
array deformable mirror device (24) and at least one 
lens (26) for creating a virtual image of each area 
array deformable mirror device (24). Each area array 
defonmable device (24) is responsive to input signals 
and reflects portions of emitted light creating a dis- 
play. The image of the reflected light may be rapidly 
changed or may be held constant to create a moving 
or stationary display as desired. 
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TECHNICAL FIELD OF THE INVENTION 

This invention relates in general to electro- 
optical devices, and more particularly, to a virtual 
display device and method of use. 

BACKGROUND OF THE INVENTION 

Advances in solid state technology are continu- 
ously reducing the size of various electronic de- 
vices including computers and calculators. How- 
ever, the size to which such devices can be re- 
duced has heretofore been limited by the size of 
the output display associated v^th such devices. 
Most miniature electronic devices currently use an 
output display selected from one of two broad 
categories of displays. In the first category, the 
display typically contains a single row of matrices 
adapted for display of alphanumeric characters. 
The matrices are typically made up of light-emit- 
ting diodes, liquid crystals, or similar elements. A 
seven segmented display belongs to this first cate- 
gory of displays. Alternatively, where a full-page 
display is required, a display from the second 
category may be selected. Typically these display 
are relatively large liquid crystal flat screen devices 
or cathode ray tubes ("CRT"). 

The first category of displays provide very little 
information, have low resolution, and are not adapt- 
ed for displaying graphics. If liquid crystal elements 
are used, then these displays are difTicult to view In 
low ambient light conditions. Conversely, if light- 
emitting diode displays are used, then these dis- 
plays are difficult to view in high ambient light 
conditions. These devices are also poorly suited for 
mounting in such a way that the viewer could view 
the display wittK>ut interrupting his normal vision. 

The larger full-page flat screen displays gen- 
erally do not have particularly high resolution, still 
permit the viewing of only limited amount of in- 
formation, and are frequently difRcurt to view in 
high or low amtnent light corKlitions. In addition, 
CRTs are relatively bulky and power intensive. 

In some special applications, CRTs project a 
virtual image through a suitable optical system to a 
partially reflective, partially transparent screen posi- 
tioned in the user's field of vision. These displays 
allow information to be superimposed onto the 
user's field of view. The user can therefor view 
t>oth computer generated information and live ac- 
tion simultaneously. Such devices, sometimes re- 
ferred to as heads-up displays ("HUDs") because 
the viewer may hold his head up and still view the 
display, are relatively expensive and cumbersome. 
They are therefore not adapted for general com- 
mercial use. 

In other special applications, HUDS have been 
developed in which the entire display may be 



mounted on a helmet or headband. Typically, these 
display systems use a plurality of linearly aligned 
light-emitting elements to produce a row of display 
pixels. Each system also includes a mirror that 

5 vibrates at a known frequency such that the vibrat- 
ing mirror synchronized with a time varying row of 
pixels creates a full-page display. Such devices are 
also relatively expensive and beconne prohibitively 
so when a full color display is desired. 

10 Therefore, a need has arisen for a visual dis- 
play system which creates a virtual image of a full- 
sized, full-page cok>r display, is relatively inexpen- 
sive, provides high resolution, can be viewed in 
any ambient light condition, consumes little power, 

16 and is suitable for use without interrupting the 
user's fiekl of vision. 

SUI\/IMARY OF THE INVENTION 

20 In accordance with the present invention, a 
visual display system and method for use is pro- 
vided which substantially eliminates or reduces dis- 
advantages and problems associated with prior dis- 
play systems. 

25 A virtual display system is disctosed compris- 
ing a light source for emitting light at least one 
area array deformable mirror device and at least 
one lens for creating a virtual image of each area 
anray defonmable minror device. Each area anray 

30 deformable device is responsive to input signals 
and reflects portions of emitted light creating a 
display. 

The first technical advantage of the disclosed 
invention is its display capability. The display may 

35 be made to produce a full page of text and graph- 
ics with resolution comparable to the VGA or the 
super-VGA graphics format. 

The second technical advantage of the device 
is its size. The display is small enough and light- 

40 weight enough to be worn from a head-mounted 
bracket The invention maintains high resolution 
and small size and weight by producing a small 
image and projecting it to create a larger one for 
viewing. 

45 Another technical advantage of the disclosed 
invention is its adaptability to include color. Color 
may be incorporated into the device by sequen- 
tially illuminating one element of the device with 
red, blue, and green light-emitting diodes or by 

60 coloring the spatial light modulating mirrors. With 
on chip filters, color may also be introduced by 
passing white light through red. green and blue 
fitters. 

Another final technical advantage of the device 
55 is its cost The device uses electronic components 
that are presently mass produced. This selection of 
subcomponents allows the final display system to 
be produced at a minimal cost. Because the device 
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is a semiconductor light modulator, no high vol- 
tages are required, and no harmful radiation is 
emitted. 

BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the 
present invention and the advantages thereof, refer- 
ence is now made to the following description 
taken in conjunction with the accompanying draw- 
ings in which: 

FIGURE 1 illustrates perspectively a first head- 
mounted display for use with the disclosed ir>- 
vention; 

FIGURE 2 depicts schematically a first embodi- 
ment of the disclosed invention; 
FIGURE 3 depicts schematically a second em- 
bodiment of the disclosed invention; 
FIGURE 4 depicts schematically a third embodi- 
ment of the disclosed invention; 
FIGURE 5 defMCts schematically a fourth em- 
bodiment of the disclosed invention; 
FIGURE 6 depicts schematically a fifth embodi- 
ment of the disclosed invention; and 
FIGURE 7 illustrates perspectively a second 
head-mounted display for use with the disclosed 
invention. 

DETAILED DESCRIPTION OF THE INVENTION 

The preferred embodiments of the present in- 
vention are illustrated in FIGURES 1 through 7 of 
the drawings, like numerals being used to refer to 
like and corresponding parts of the various draw- 
ings. 

FIGURE 1 illustrates perspectively a first head- 
mounted display for use with the disclosed inverv- 
tion. The virtual display system 10 may comprise a 
headband 12, a bracket 14, and a projector 16. 
Virtual display system 10 is designed to be small 
enough and light weight enough that it may be 
worn on the head as illustrated by a user 18. 
Projector 16 is connected to driving circuitry (not 
shown), such as a microprocessor^ which generates 
data to be displayed. The microprocessor may be 
also worn by the user 18 or may be a stationary 
apparatus connected to user 18 by electrical leads. 
Prc^'ector 16 is aligned in front of only one eye of 
user 18 so that information displayed by system 10 
will appear to be floating in space at a predeter- 
mined distance in front of user 18. In this way, 
virtual display system 10 may operate without in- 
terfering with the user's normal field of view. Pro- 
jector 16 displays a virtual image to user 18 as will 
be described more fully below. 

FIGURE 2 depicts schematically a first embodi- 
ment of the disclosed invention that may t>e incor- 
porated into projector 16 (shown in FIGURE 1). 



Projector 16 comprises a light source 20, an an- 
amorphic condenser lens 22, a deformat>le mirror 
devrce 24 ("DMD*^. an imaging lens 26, and a 
scanner 28. 

5 In operation, the light from light source 20 is 

uniformly directed to the active surface of DMD 24 
by anamorphic condenser lens 22. Selected por- 
tions of the light incident upon DMD 24 are re- 
flected by DMD 24 to imaging lens 26 and scanner 

10 28. The output from imaging lens 26 is applied to 
scanner 28. Imaging lens 26 will create a magnified 
virtual image of DMD 24, if DMD 24 is located at 
or near, the focal point of imaging lens 26. Scanner 
28 is made to rapidly oscillate through a small 

76 angle such that user 18 sees the line image of 
DMD 24 scanned so as to present a full page 
display. The optical pathway of light from light 
source 20 is depicted as a series of dashed lines in 
FIGURES 2 through 6. 

20 In this first embodiment of FIGURE 2, DMD 24 
contains a single row of individually deformable 
mirrors. Each mirror is typically a small square or 
diamond having sides of 12 to 20 microns in 
length. Atypk:al one-inch long DMD can, therefore, 

25 have approximately 2,000 individually deformable 
mirrors. Each of the mirrors of DMD 24 reflects 
light along one of a plurality of optical pathways. 
Typically, DMD 24 is comprised of bistable mirrors; 
meaning that each mirror reflects light along one of 

30 two optical pathways. One of the two pathways is 
aligned with condenser lens 26 and scanner 2a 
Along which of each optical pathways each mirror 
reflects light is dependent upon input signals and 
may vary rapidly as a function of time. JUe operat- 
es ing characteristics and fabrteation techniques of 
DMD 24 are well known by those skilled in the art 
and are more fully described in U.S. Patent No. 
4,662,746 "Spatial Light Modulator and Method" to 
Hornbeck. et al., issued May 5. 1987. Hornbeck. et 

40 al. is incorporated herein by reference. 

As discussed previously, a mirror associated 
with scanner 28 is made to vibrate through a small 
scan angle in the range of 50-100 Hz with a single 
light source 20. As scanner 28 vibrates, the point at 

4S which the light from DMD 24 is projected onto the 
scanner mirror varies. Thus, by selectively deflect- 
ing various mirrors of DMD 24 at various points in 
the vibratkMi of scanner 28, successive rows of 
pixels (i.e., display spots) will be combined to form 

so an area image for the viewer. With the scanner 
being refreshed at approximately 100 Hz, the per- 
sistence of the user's eye is sufficient to eliminate 
flicker and create the illusion of a continuous full 
page virtual image at the minror. This process of 

55 scanning successive rows of pixels to create a full 
page display is well known in the art. 

Scanner 28 is deputed as a resonant mirror 
manufactured by Reflection Technology, Inc., of 



3 



5 



EP 0 547 493 A1 



6 



Walthom, Massachusetts. Other suitable devices 
may be selected from the IB series optical scan- 
ners available from General Scanning, Inc., of 
Watertown, Massachusetts. 

RGURE 3 depicts schematically a second em- 
bodiment of the disclosed invention that may be 
incorporated into projector 16 (shown in FIGURE 
1). Here, scanner 28 has been replaced with a 
resonant minror 30 manufactured using the defor- 
mable mirror device process. The operation and 
manufacturer of resident mirror 30 is more fully 
de3crit>ed in Application for U.S. Patent Serial No. 
07/81 1 p407, "Resonant Mirror and Method of Manu- 
facture," filed 20 December . 1991 and in Applica- 
tion for U.S. Patent Serial No. 07/811.408 , "Method 
of Steering Light," filed 20 December , 1991, both 
to William Edward h4elson. These applications and 
the present application are both assigned to Texas 
Instruments, Inc. of Dallas. Texas. In summary, 
resonant mirror 30 comprises a small mirror ap- 
proximately 1 inch by V4 of an inch which may be 
made to oscillate at a predetermined frequency by 
the application of electrostatic charges. Resonant 
mirror 30 may therefore achieve the same effect as 
scanner 30, (shown in FIGURE 2) in a smaller more 
energy efficient package. 

RGURE 4 depicts schematically a third em- 
t>odiment of the disclosed invention that may be 
incorporated into projector 16 (shown in FIGURE 
1). Here, light source 20 has been replaced with a 
plurality of light emitting elements 32. Light emit- 
ting elements 32 might comprise a red, a t>lue, and 
a green light emitting element to produce a full 
three color virtual image. In operation, light emitting 
elements 32 are illuminated individually while an 
entire screen of the display is scanned by, for 
instance, resonant mirror 30. Other scanners may 
be incorporated into projector 16 as described 
above. After an entire frame is scanned in one 
color, the first light emitting element is switched off 
and a second light emitting element is switched on. 
The second color is added to the display as DMD 
24 and resonant mirror 30 scan that portion of the 
displayed page corresponding to the second color. 
The third color is then added in the same way. 
Alternatively, DMD 24 may be made to scan each 
color of each row before moving on to the next 
display pixel row. In the first scheme, the display is 
scanned three times, once for each color. In the 
second scheme, the display is scanned only once 
for each frame of the image at approximately 1/3 
speed of the first scheme. The scan rate of DMD 
24 and resonant mirror 30 may have to be in- 
creased in this embodiment to present a flicker 
free display. 

FIGURE 5 depicts schematically a fourth em- 
t>odiment of the disclosed invention for use with 
projector 16 (shown in RGURE 1). Here, DMD 24 



and scanner 28 have been replaced with an area 
anray DMD 34 and a plain minrcM' 36 respectively. 
An area array DMD is a DMD comprised of a n x m 
matrix of deformable mirrors. Area array DMD 34 

5 may, for instance, contain a 640 x 480 matrix of 
mirrors. Area array DMD 34 may tiierefore simulta- 
neously display an entire page of a display with 
resolution comparable to present cathode ray 
tubes. In such a case, a scanner is not necessary 

10 to create a full page display. Mirror 36, however, 
may be added to projector 16 to more conveniently 
position the virtual image with respect to the view- 
er. 

Area anray DMD 34 may be combined with a 

16 plurality light emitting elements 32 (shown in FIG- 
URE 4) to produce a full color display. In such a 
scheme, each light emitting element 32 would be 
illuminated sequentially while area anray DMD 34 
reflects all of that portion of a full page of display 

20 corresponding to a particular color. This process is 
then repeated for the remaining light emitting ele- 
ments and their conresponding images until an 
entire three-color visual display is projected. Alter- 
natively, area array DMD 34 may be advantageous- 

25 ly dyed to produce a plurality of three color pixels. 
In this case, area anray DMD 34 may produce full 
color images with a white light source. The process 
by which area array DMD 34 is dyed to produce a 
plurality of three color pixels is more fully de- 

30 scribed in application for U.S. Patent Serial No. 
07^9078, "Color Deformable Mirror Device and 
Method for Manufacture", filed July 31, 1991 to 
William Edward Nelson. Color Deformable Min'or 
Device and Method for Manufacture is also as- 

3s signed to Texas Instruments. Inc. of Dallas. Texas. 
It is incorporated herein by reference. 

FIGURE 6 depicts schematically a fifth embodi- 
ment of the disclosed invention for use with projec- 
tor 16 (shown in FIGURE 1). Here, a light source 

40 20 illuminates a modified DMD 38. Modified DMD 
38 comprises a plurality of rows 40 of deformable 
mirrors and an optically transparent filter sheet 42. 
RIter sheet 42 comprises a plurality of filter strips 
(indicated by parallel rectangular structures) super- 

45 Imposed thereon which align themseh^es with the 
plurality of rows of deformable mirrors 40. For 
instance, DMD 38 may comprise three rows of 
deformable mirrors and filter sheet 42 may com- 
prise red, green and blue filter strips. The offset of 

50 each row 40 as seen by a viewer may be ac- 
counted for electronically and again, a full color 
virtual display may be created using a single light 
source 20. lenses 22 and 26, and scanner 28. 
Scanner 28 may be a scanner of the type manufac- 

55 tured by Texas Instruments, Reflection Technology 
or by General Scanning. 

FIGURE 7 illustrates perspectively a second 
head-mounted display 44 for use with the disclosed 
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invention. Head-mounted display 44 comprises a 
helmet 46 to t>e worn by a user, a screen 48 on 
which a virtual image may be projected, and a light 
transmission system 50, Screen 48 may itself be 
partially silvered to allow the user to better see 
both the projected virtual display and his forward 
field of view. Light transmission system 50 typically 
comprises a bundle of fiber optic filaments which 
transmit to screen 48 a virtual image from a remote 
location. Light transmission system 50 connects to 
a projector (depicted iri RGUREs 2-6). The projec- 
tor may be located in a more convenient site such 
as the user*s waist or may be permanently incor- 
porated within the electronics of a vehicle such as 
a car or airplane. 

A stereoscopic virtual display may also be cre- 
ated by simuttaneously using two of the displays 
depicted In RGUREs 2 through 6, In that case, a 
virtual display is mounted in front of each one of 
the viewer's eyes and each display projects one of 
two related images. Each image corresponds to 
that half of the image which would be perceived by 
the corresponding eye if the image were, in fact, 
real. The process of generating a three-dimensional 
image from two related two-dimensional images is 
known in the art 

Although the present invention has t>een de- 
scribed in detail, it should be understood that var- 
ious changes, substitutions, and alterations can be 
made hereto without departing from the spirit and 
scope of the invention as defined by the appended 
claims. 

Claims 

1. A virtual display system comprising: 

at least one light source for emitting light 
at least one deformable mirror device respon- 
sive to input signals for reflecting portions of 
the emitted light; and 

at least one lens for creating a virtual image of 
each deformable mirror device. 

2. The virtual display system of daim 1, wherein 
the or each deformable mirror device is an 
area array deformable mirror device. 

3. The virtual display system of claim 1 or daim 
2, wherein each defbrmat>le mirror device fur- 
ther comprises a plurality of three-color pixels. 

4. The virtual display system of any preceding 
claim, wherein each light source further com- 
prises a plurality of colored light emitting ele- 
ments. 

& The virtual display system of claim 4. wherein 
the light source further comprises: 



a red light emitting element; 

a blue light emitting element and 

a green light emitting element. 

5 6. The virtual display system of any preceding 
claim further comprising: 
at least one scanner for reflecting virtual image 
through an angle to create a display. 

10 7. The virtual display system of claim 6, wherein 
each scanner comprises an optical scanner. 

& The virtual display system of claim 6 or claim 
7, wherein each scanner further comprises a 
16 resonant mirror. 

9. The virtual display system of any preceding 
daim, wherein each deformable mirror device 
further comprises: 
20 a plurality of rows of defonmable mirrors; and 

a plurality of rows of color filter elements, each 
filter element aligned with a row of deformable 
mirrors. 

25 10. A head-mounted virtual display system to be 
worn by a user comprising: 
a helmet to be worn by the user; 
at least one screen mounted to the helmet for 
displaying at least one virtual image to the 

30 user; 

at least one light source for emitting light; 
at least one deformatHe mirror device for re- 
flecting portions of the emitted light responsive 
to input signals; 

35 at least one lens for creating a virtual image of 
the defonmable minor device; and 
at least one light transmission system for 
transmitting the virtual image of the deformable 
mirror device to the screen. 

40 

11. The head-mounted virtual display system of 
claim 10, wherein the light transmission sys- 
tem further c(Mnprises at least one bundle of 
fiber optic filaments. 

45 

12. The head-mounted virtual display system of 
claim 10 or claim 11, further comprising at 
least one scanner for reflecting each virtual 
image through an angle to create a two-dimen- 

50 sional display. 

13. The head-mounted virtual display system of 
any of claims 10 to 12, wherein each light 
source comprises a plurality of colored light 

55 sources. 

14. The virtual display system of any of claims 10 
to 13, wherein the light source comprises: 
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a red light emitting element; 

a blue light emitting element; and 

a green light emitting element 

15. The head-mounted virtual display system of s 
any of claims 10 to 14, wherein each deffor- 
mable mirror device comprises an area array 
deformable mirror device. 

16. The head-mounted virtual display system of io 
claim 15. wherein each area array deformable 
mirror device further comprises a pluralrty of 
three-color pixels. 

17. A metiiod for displaying at least one virtual 75 
image comprising the steps of: 

illuminating at least one deformable minror de- 
vice with light; 

deflecting certain of the deformable mirrors 
responsive to input signals to reflect portions 20 
of the light; and 

projecting the reflected portions 0! the light 
through at least one lens to create at least one 
virtual image of the deformable mirror device. 

25 
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